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Abstract 

We present detailed analysis of the convergence prop- 
erties and effectiveness of Lyapunov control design for 
bilinear Hamiltonian quantum systems based on the ap- 
plication of LaSalle's invariance principle and stability 
analysis from dynamical systems and control theory. 
For a certain class of Hamiltonians, strong convergence 
results can be obtained for both pure and mixed state 
systems. The control Hamiltonians for realistic physi- 
cal systems, however, generally do not fall in this class. 
It is shown that the effectiveness of Lyapunov control 
design in this case is significantly diminished. 
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1 Introduction 

Control of quantum phenomena is becoming increas- 
ingly important in many divergent areas of research 
including quantum computation, quantum chemistry, 
nano-scale materials, and Bose-Einstein condensates. 
Accordingly, quantum control theory has developed 
greatly in both depth and breath in recent years, 
and many results about controllability and control 
methods have been obtained. Broadly speaking, 
quantum control approaches fall into two categories: 
open-loop Hamiltonian (and sometimes reservoir) 
engineering using a variety of techniques including 
optimal control | Shi, Woody and Rabitz, 1998] 



Maday and Turinici, 2003 



Schirmer, Girardeau and Leahy, 2000 1 



and 



geometric designs |Jurdjevic, 1997 



Jurdjevic and Sussmann, 1972 



Koch and Lowenthal, 1975T ~ |D'alessandro, 20001 
Schirm er, 2002), and closed-loop quantum state 
reduction and stabilization using feedback from 
weak measurements [Wiseman and Mil burn, 1993[ 
| Wiseman, 1994) . 
Lyapunov functions have played a significant 
role in control design. Originally used in feed- 



back control to analyze the stability of the con- 
trolled system, they have formed the basis for 
new control designs, and several recent papers 
have discussed the application of Lyapunov con- 
trol designs to quantum systems JVettori, 2002; 
Ferr ante, Pavon and Raccanelli, 2 002 ; 
Grivopoulus and Bamieh7"2003| 



Mirrahimi and Rouchon, 2004a 



Mirrahimi and Rouchon, 2004b ; 
|Mirrahimi and Turinici, 2005 1 |Altafini, 200711 

lAltafini, 2007bl . Although the basic math- 
ematical formalism is well established, us- 
ing either the Schrodinger equation for 
pure state wavefunctions HVettori, 2002 ; 
|Ferrante, Pavon and Raccanelli, 2002| 
|Grivopoulus and Bamieh, 2003), or the Liou ville- 



von Neumann equation | von-Neumann, 1935) for 
density operators lAltafini, 2007al |Altafini, 20 07b |, 
many questions remain. For example, some 
sufficient conditions for the method to be ef- 
fective, i.e., guarantee convergence of the sys- 
tem state converges to the target state, have 
been obtained [Mirra himi and Rouchon, 2 004a, 
IMirrahimi and Rouchon, 2004bl 
|Mirrahimi and Turinici, 2005 1 |Altafini, 2007al 

Altafini, 2007b |, but are they also necessary? What 
are explicit requirements on the Hamiltonian and the 
target state such that the control is effective? 
Moreover, there are outstanding technical issues. 
The invariance principle [LaS alle and Lefschetz, 1961] 
should be applied to autonomous systems, and its ap- 
plication for time-dependent target states needs care- 
ful justification. Moreover, the trajectory of time- 
dependent target state under free evolution is gener- 
ally not periodic, as previously asserted in the liter- 
ature [Altafini, 2007b]. We address these issues and 
present a detailed analysis of the relationship between 
the effectiveness of Lyapunov control design and the 
parameters in the control problem, the Hamiltonian and 
the target state. In section II, we establish the mathe- 
matical model for the quantum system controlled by 
Lyapunov method, and apply LaSalle invariance prin- 



ciple to analyze the convergence condition. In section 
III and IV, we will use the results in section II to discuss 
the Lyapunov control of pseudo-pure state and generic 
state, under an ideal condition of the Hamiltonian; in 
section V, we shall relax this condition and see how the 
effectiveness of Lyapunov control will change. 

2 Control System and Invariance Principle 

2.1 Controlled dynamics and Lyapunov function 

A controlled quantum system can be modelled in dif- 
ferent ways, either as a closed system evolving unitarily 
under certain Hamiltonian, or as an open system inter- 
acting with a heat bath. In this paper, we restrict our 
discussion to an n-level bilinear Hamiltonian dynami- 
cal system satisfying the Liouville-von Neumann equa- 
tion: (assuming h = 1): 

p(t)=-i[H + f(t)H liP {t)], (1) 

where p is a positive trace-one operator, representing 
the system state, Hq is the free evolution Hamiltonian 
and Hi is the controlled Hamiltonian, both of which 
are constant. In the special case when the system is in a 
pure state \ip), we have p = \ip)(i/j\, and the dynamical 
system can be represented as: 

TP(t) = -i(H + f(t)H 1 ) 1 p(t) (2) 

although we will use the density operator formulation 
throughout this paper. The general control task we con- 
sider can be formulated as, given a target state p d , we 
wish to apply a certain control field f(t) to the sys- 
tem that modifies its dynamics such that p(t) — > pd as 
t — > +oo. Since the free Hamiltonian Hq can gener- 
ally not be turned off, it is natural to assume pd to be 
time-dependent, satisfying: 

Pd(t) = -i[H ,p d (t)}. (3) 

Since the evolution of both p(t) and pd(t) is unitary 
in our case, we require p(0) to be unitarily equivalent 
to Pd{0)- Hence, the state space Ai is the set of all 
density operators p such that p and p d (Q) are unitarily 
equivalent. This is a compact manifold, called a flag 
manifold, whose dimension depends on the number of 
distinct eigenvalues of pd- We say pd is pseudo-pure 
if its spectrum has only two distinct values, one occur- 
ring with multiplicity one and the other with multiplic- 
ity n — 1, and pd is generic if it has n non-degenerate 
eigenvalues. We have 2n — 2 < dim(.M) < n 2 — n 
with dim(A / J) = n 2 — n for generic pd and dim(A^) = 
2n — 2 for pure or pseudo-pure states. 
Define a function V on M. x M: 

V(p,p d ) = ~Tr((p-p d f) 

= Tr(p 2 d )-Tr(p d p). (4) 



We have V > with equality only if p = pd- Taking 
derivative of V along any solution (p(t), p d (t)), and 
substituting (Q~|) and ||3}, we derive: 

V = - Tr(p d p) - Tr(p d p) 

= - Tr([-iF ,p d ]p) - Tr(p d [-iH 0) p\) 

- f{t)TY{ Pd [-iH llP ]) 
= -f(t)Tr(p d [-iH 1 ,p]). 



If we choose f(t) = nTr(pd[—iHi, p\), n > 0, then 
V (p(t) , pd{t)) < 0. Hence, V is a Lyapunov function 
for the following autonomous dynamical system with 
respect to (p(t), p d (t)): 

p(t) = -i[H + f{p,p d )H u p(t)] 
p d (t) = -i[H ,p d (t)} (5) 
f(p,Pd) = nTrQ-iHt, p]p d ) 

2.2 LaSalle invariance principle and invariant set 

To complete the control task, we require p(t) — * p d (t) 
as t — * +oo, which is equivalent to V(p(t), p d (t)) — > 
0. A key result for the convergence analysis is LaSalle's 
invariance principle [LaS alle and Lefschetz, 19611 : 

Theorem 2.1. Let V(x) be a Lyapunov function on the 
phase space — {x} of an autonomous dynamical 
system x = f{x), satisfying V(x) > for all x 7^ xq 
and V(x) < 0. Let 0(x(t)) be the orbit of x(t) in 
fl. Then the invariant set E — {0(x(t))\V(x(t)) = 
0}, contains the positive limiting sets of all bounded 
solutions, i.e., any bounded solution converges to E as 
t — * +00. 

For our quantum dynamical system (0, since the state 
space Ai is compact, any solution (p(t),p d (t)) is 
bounded. Applying LaSalle Invariance Principle we 
obtain |Wang and Schirmer, 2008 1: 

Theorem 2.2. The state (p(t), p d (t)) of the au- 
tonomous dynamical system Q converges to the invari- 
ant set E = {{pi, pi) € M x M\V(p(t),p d (t)) = 
0,(p(0),p d (0)) = ( Pl ,p 2 )}. 

Therefore, the next step is to determine the invariant set 
E, for the dynamical system @. Notice that in LaSalle 
invariance principle, E contains the positive limiting 
points of all bounded solutions for any p d (t). Hence, in 
the following, we always restrict the calculation of E to 
the points (p±, p 2 ) such that p 2 is the positive limiting 
point of the given p d (t). For our dynamical system, the 
invariant set E — {V (p(t) , p d {t)) = 0} is equivalent 



to f(t) = 0, for any t: 



basis {A fc , A fe £, A^}, where 



= f = Tc([-iH 1 ,p]p d ) 
= f = Tr(Hif llP ]p d ) +Tr([-iff 1 ,p]p d ) 
= -Tr([[-iH ,-iH 1 ] ) p}p d ) 



= ^ = (-irTr([AdU Ho (-m),p] Pd ), 



where Adr_ iHo (—iHi) represents ^-fold commuta- 
tor adjoint action of — iHo on —iHi. Hence, 
Tr([A,B]C) = -Tr([C,B]A) = -Tr{[A,C]B) 
gives a necessary condition for the invariant set E: 



A 



7=(eit + e 22 H h e„, n ) 



f(ei 



Tr([p,p rf ]Ad™ Ho Hff 1 ))-0, 



(6) 



where Ad^j^ (— iH\) — —iH\ and m is any non- 
negative integer. Hence the invariant E depends on 
both the Hamiltonian and the target state. Without 
loss of generality, we assume Hq and H\ to be trace- 
zero. Since Hq is hermitian and therefore diagonal- 
izable, we may assume Hq = diag(ai, . . . , a n ), with 
diagonal elements arranged in decreasing order, where 
the diagonal elements physically represent the energy 
levels of the system. We shall assume Hi to be off- 
diagonal in this basis with off-diagonal elements bke 
representing the couplings between the energy levels k 
and I, Also let ujke — cie — be the transition fre- 
quency between the energy levels k and I. With these 
assumptions, we can prove the following useful theo- 
rem JWang and Schirmer, 2008) : 

Theorem 2.3. If (1) Hq strongly regular, i.e., lu^i ^ 
uipq unless (k,£) = (p,q), and (2) Hi fully connected, 
i.e., bki 7^ except for k — t, then (pi, p 2 ) belongs to 
the invariant set E if and only if [pi, p2\ is diagonal. 

We note that these conditions on the Hamiltonian are 
very strong and rarely satisfied for real physical sys- 
tems. However, this is the ideal case for Lyapunov 
control design, and it is useful to begin by analyzing 
the effectiveness of the method in this ideal case before 
relaxing the requirements. 



2.3 Real representation for quantum systems 

In order to apply stability analysis to our complex 
quantum dynamical system, we require a real represen- 
tation for both the Hamiltonian and the density opera- 
tor. Let £>r(7Y) be the real vector space of all n x n 
Hermitian matrices on the Hilbert space H. For any 
Hi,H2 £ Sjr(W), we can define an inner product 
(H\\H2) = Tt(HiH2), and an associated orthonormal 



Afe£ = (— e k e + e«c), 



' ,, „ ) (7a) 
e-kk - kik+i^k+i) (7b) 
(7c) 
(7d) 



m - 


= [Ao + Ai 


)s(t) 


t d (t) = 


■■ A s d (t) 




/(*) = 


= ^Ais 




Ad_i ffo 


and A\ = 


Ad_ 



ike being the elementary matrix with 1 in the (k, I) po- 
sition and elsewhere, and 1 < k < I < n. In this 
basis, any hermitian matrix H can be represented as 
an n 2 -dimensional real vector. For density operators p 
with Tr(/?) = 1 the coefficient of Ao is constant and 
thus can be dropped. Let s(t) and Sd(t) be the vec- 
tors in EL representing p(t) and p d {t). The adjoint 
action Ad^ (p) — [iH, p] in this basis is given by an 
anti-symmetric matrix A acting on s(t). Therefore, the 
quantum dynamical system (0 can be equivalently rep- 
resented as: 



(8) 



io = Au_jjj anu s±i = AU-j/fj. This real 
representation is generally known as the Bloch vector 
form especially for n = 2. 

3 Convergence Analysis for Ideal Systems 

In this section we consider ideal systems, i.e., systems 
with Hq strongly regular and Hi fully connected. If the 
system and hence the Hamiltonian are fixed, the invari- 
ant set E depends on the target state p d only. In general, 
the convergence analysis depends on the spectrum of 
the target state p d , in particular the multiplicities of its 
eigenvalues. As we cannot give a complete discussion 
of all possible cases here, we will focus on two cases of 
crucial importance, (a) when p d is a generic mixed state 
with n non-degenerate eigenvalues, and (b) when p d is 
a pure or pseudo-pure state with only two eigenvalues 
with multiplicities 1 and n — 1, respectively, starting 
with the two-level case. 

3.1 Pseudo-pure states 

We start with the special case of a two-level sys- 
tem, for which the embedding of density operators into 
H" gives rise to a homeomorphism between den- 
sity operators and points inside a closed ball in IR 3 , 
with pure states forming the surface of the ball, and 
the completely mixed state (0, 0, 0) its centre. In this 
case there is no distinction between pseudo-pure and 
generic states, all states except the completely mixed 
state po = diag(^, ^) being both generic and pseudo- 
pure. Furthermore, the requirements of strong regular- 
ity of Hq and full connectedness of Hi are always satis- 
fied for a two-level systems, except for the trivial cases 



of systems with a single degenerate state or no coupling 
to the control field. Excluding these trivial cases, The- 
orem [23] implies that all (pi,p2) € E satisfy [p\,p2\ 
diagonal, and one can show that there are three types of 
points in the invariant set |Wang and Schirmer, 2008 1 

(a) Tr(pip 2 ) = 1, i.e., pi = p 2 ; 

(b) Tr( PlP2 ) = 0; 

(c) Tr[Aipi] - Tr[A lP2 ] = 0. 

Another special feature of the n = 2 case is that for any 
choice of Hq, the trajectory of pd(t) forms a periodic 
orbit O(pd(0)), which is a compact set, so any pos- 
itive limiting point (p\,p2) of (p(t) , Pd(t)) must sat- 
isfy p2 G O(pd{0)). Therefore, if pd(0) has nonzero 
Ai component, i.e., Tr(pd(0)\i) ^ then E can only 
contain the cases (a) and (b), corresponding to the val- 
ues of Lyapunov function V — V max and V = 0. 
Hence, for any p(t) with Ti(p(0)pd(0j) ^ 0, we have 
V (p(0) , pd(0)) < Vmax and LaSalle's invariance prin- 
ciple guarantees that V(p(t), Pd(t)) — * and p(t) — > 
Pd(t) as t — ► +oo. Lyapunov control in this case is an 
effective strategy. 

If pd(0) has zero Ai component, however, then the in- 
variant set E contains all points (pi/c^) satisfying (c), 
the value of the Lyapunov function V on E spans the 
entire interval [0, Vmax]> an d we cannot conclude that 
p(t) — ► pd{t). Indeed simulations suggest that V can 
tend to any value in [0, V max ] in this case. We can still 
conclude that p(t) converges to the set 0(pd(t)) corre- 
sponding to the orbit of pd(t) but this is a substantially 
weaker notion of convergence as there are infinitely 
many distinct states whose orbits under free evolution 
coincide. 

If we take the Bloch vector to be s = (x, y, z) with 
x = Tr(pAi 2 ), y = Tr{pXii) and z = Tr^Ai), as 
usual for n = 2, then case (a) corresponds to si = s 2 , 
case (b) corresponds to s± being antipodal to s 2 , s*i = 
— s 2 , and (c) corresponds to the target state lying on 
the equator of the sphere. If Sd(0) is not on the equa- 
tor, all solutions s(t) with s(0) ^ — s*d(0) converge to 
s d (t). If Sd{0) is on the equator, any solution s(t) will 
converge to the equator but s(t) Sd(t) in general. 
The picture is the same for all equivalence classes of 
states, except the completely mixed state, the only dif- 
ference being that pure states lie on the surface of the 
ball, while pseudo-pure states with the same spectrum 
lie on concentric spherical shells of in the interior. 

For n > 2 pseudo-pure states are exceptional or non- 
generic and the mapping from density operators into 
2 — l 

H" provided by the Bloch vector is only an em- 
bedding, not a homeomorphism. Furthermore, the con- 
ditions on the Hamiltonian of strong regularity and 
complete connectedness are less trivial in this case as 
there are many systems that are connected and regular 
and controllable, but not strongly regular or fully con- 
nected. However, assuming such ideal Hamiltonians 
we can still prove | Wang and Schirmer, 2008 1: 

Theorem 3.1. Given a pseudo-pure state target state 
Pd(t) with spectrum {w, u} and ideal Hamiltonians as 



defined above, Lyapunov control is effective, i.e., any 
solution p(t) with V (p(0) , pd(0)) < Vmax will con- 
verge to Pd(t) as t — > +oo, except when pd has a 
single pair of non-zero off-diagonal entries of the form 
ru{t) = \-{w - u)e ta and r kk = r u = \(w + u). 
In the latter case any solution p(t) will converge to the 
orbit of pd(t) but in general p(t) -/^ pd{t) as t — > +oo 
and V(p, pd) can take any limiting value between and 

'max- 

This theorem essentially asserts that if Hq is strongly 
regular, Hi is fully connected and pd is a pseudo-pure 
state whose dynamics is not confined to a periodic or- 
bit in a two-dimensional subspace, then any solution 
p{t) with Tr(p(0)p d (0)) ^ will converge to p d {t) as 
t — > +oo. Thus for n > 2 the special case where p(t) 
converges to the orbit 0(pd{t)) but not pd{t), corre- 
sponding to case (c) above, is precluded, except when 
the target state is such that its orbit is a periodic or- 
bit (circle) in a in a 2D subspace. Given any other 
pseudo-pure state pd{t), all initial states p(0) that are 
not part of the critical manifold of states for which 
Tr(p(0)p,j(0)) = and V assumes its maximum, will 
converge to the target state pd(t) for t — > oo. 

3.2 Generic states for n-level systems 

For n > 2 pseudo-pure states are a very small subset 
of the state space. Most states p are generic with n 
non-degenerate eigenvalues. We distinguish two cases 
here: stationary target states pd, which are diagonal (in 
the eigenbasis of Hq), and non-stationary target states. 
When pd is stationary, the dynamical system © can be 
reduced to 



p(t) = -i[H +f(p)H 1 ,p(t)] 
f(p) = Tr([-iH u p(t)]p d ) 



(9) 



and the invariant set (for an ideal system) reduces ac- 
cordingly to E = {pol^O(i)) = 0,p(0) = p }, 
which can be shown to be equivalent to the set of all po 
with [po, pd] diagonal. Furthermore, since pd is station- 
ary and thus diagonal, the latter condition can further 
be reduced to [po, pd] — by virtue of the following: 

Lemma 3.1. If A is diagonal with non-degenerate 
eigenvalues and [A, B] is diagonal, then B is also di- 
agonal and [A, B] = 0. 

The proof follows trivially from the fact that for 
A = diag(ai,...,a„) and B = (b mn ), the (m,n) 
component of [A, B] is b mn (a m — a n ). If [A, B] 
is diagonal and a m ^ a n then we must have 
for m 7^ n. This leads to the follow- 



ing | Wang and Schirmer, 2 008 1 : 



Theorem 3.2. If pd is a generic stationary target state 
then the invariant set E contains exactly the n\ criti- 
cal points of the Lyapunov function V(p) = Tr(p^) — 

Tr(ppd), i.e., the stationary states p d k \ k = 1, . . . , n!, 
which commute with pd and have the same spectrum. 



pi 



12 
1 



12 
II 

24 
1 



11 



P2 




As pa is stationary and therefore diagonal, it follows Example 3.1. Consider p\ and pd(0) — P2 with 

(k) 

that all p d ' are also diagonal, and their diagonal ele- 
ments are a permutation of those of p d . Since Tr(p^) is 
constant for a Hamiltonian system, the critical points 
of V(p) coincide with the critical points of J(p) = 
Tr(pdp), which can be regarded as the expectation 
value of the observable A — pd- We can immediately 
see that V assumes its global minimum when the ex- 
pectation value of Ti(pdp) assumes its maximum, i.e., 
for p = pd, and its maximum when J(p) assumes its 
minimum. Assuming p d — pd — diag(ifi 5 . . . , w n ) 
and p d "' } = diag(w r (!),... ,w T(n) ), where r is 
the permutation of {1, . . . , n} that corresponds to a 
complete inversion, i.e., r(fc) = n + 1 — k, we 
have {Girardeau, Schirme rj Leahy and Koch, 1998[ : 



pi and p2 are isospectral and we have 



[PuPi] = 



'0 

U 144 1 







11 



,0 -^i; 



j( P { ; ]) )< j( P )< j{ Pd '>) 



(10) 



i.e., pv' and p d n ^ correspond to the global extrema of 
V with V = and V = V max = J2k w k> respectively. 
It is furthermore easy to show that for a given generic 
stationary state p d the critical points of the Lyapunov 
function V(p) are hyperbolic. However, since the 
dynamical system defined by our Lyapunov control 
is not the gradient flow of V(p), asymptotic stabil- 
ity of these fixed points can not be derived directly 
from the associated index number of the Morse func- 
tion V. Nonetheless, further analysis of the lineariza- 
tion of the dynamics near the critical points shows 



that | Wang and Schirmer, 2008 1: 



Theorem 3.3. For a generic stationary target state p d 
all the critical points of the dynamical system (O are 
hyperbolic, pd is the only sink, all other critical points 
are saddles, except the global maximum, which is a 
source. 

Since the critical points of the dynamical system ([5]) 
for a generic stationary state pd are hyperbolic and 
they are also hyperbolic critical points of the function 
V{p) = V{p, pd), the dimension of the stable manifold 
at a critical point must be the same as the index num- 
ber of the critical point of the function V. In particular, 
since all critical points except the global minimum and 
maximum are saddle points, they are not repulsive, and 
therefore there are solutions p(t) outside E that con- 
verge to these saddles, resulting in the failure of the 
Lyapunov control method. However, as the dimensions 
of the stable manifolds at these points are smaller than 
dim(A / t), almost all solutions will still converge to the 
global minimum p^ — pd, and thus the Lyapunov 
method is still (mostly) effective. 

When the target state p d is not stationary, the situa- 
tion is somewhat more complicated as the invariant set 
E may contain points with nonzero diagonal commu- 
tators. 



i.e., (pi,p 2 ) G Ebut [fti,p 2 ] ^ 0. 

Simulations suggest that p(t) does not converge to 
Pd(t) or 0(pd(t)) in this case and thus Lyapunov con- 
trol fails. It is difficult to give a rigorous proof of this 
observation, however, as we lack a constructive method 
to ascertain asymptotic stability near a non-stationary 
solution. In the special case where Pd{t) is periodic 
there are tools such as Poincare maps but it is difficult 
to write down an explicit form of the Poincare map for 
general periodic orbits [Perko, 2000]. Moreover, as ob- 
served earlier, for n > 2 the orbits of non-stationary 
target states pdif) under Hq are periodic only in some 
exceptional cases. 

Fortunately, however, E — {[pi, p 2 ] = 0} still holds 
for a very large class of generic target states p d (t), and 
in these cases Lyapunov control tends to be effective. 
Setting [pijpa] = — Ad P2 (pi), where Ad P2 is a lin- 
ear map from the Hermitian or anti-Hermitian matrices 
into su(n), let A(s 2 ) be the real (n 2 — 1) x (n 2 — 1) 
matrix corresponding to the Stokes representation of 



Ad P2 . Recall su(n) = T © C and HT 



St 



Sc, where Sc and St are the real subspaces corre- 
sponding to the Cartan and non-Cartan subspaces, C 
and T, respectively. Let A{s2) be the first n 2 — n 
rows of A(s2) (whose image is St)- Then we can 
show [Wang and Sc hirmer, 2008 ] : 

Theorem 3.4. The invariant set E for a generic p d (t) 
contains points with nonzero commutator only if either 
Pd has some equal diagonal elements or det(vli) = 0. 
Therefore, the set of p d {§) such that E contains points 
with nonzero commutator has measure zero with re- 
spect to the state space M. 

Hence, if we choose a generic target state p d (0) 
randomly, with probability one, it will be such that 
E = {[pi, p2[ = 0}. Choosing an orthonormal ba- 
sis such that p2 is diagonal, it thus follows that p\ 
must be diagonal in this basis, and its diagonal ele- 
ments a permutation of the eigenvalues of p 2 . Thus 
for a given target state p 2 = Pd, there are again 
n! critical points (p d k \t), p d (t)). Moreover, for any 

(pi,P2) G E with p 2 = Pd and p 1 = p^ for 
some k, there exists a subsequence {t n } such that 
(p(t„),pd(t n )) -> (pi, pa). In particular, p(t n ) -> pi, 



Pd{t n ) -» pi, and hence, pf\t n ) -> p[ k) = p x . 
Therefore, we have p(t n ) — > p d k \t n ). If {pi, pi) € -E 
is a different positive limiting point of Pd(t)), 
since V(,o(i), Pd(t)) decreases along the trajectory 
and the nl critical points are isolated, we must have 
pi = pi for the same k as for (pi,/?2)- There- 
fore, p(t n ) — > p d (t n ) holds for any positive limit- 
ing point (pi, p 2 ) and the corresponding subsequence 



(Pi) P2) S -E must satisfy: 



{in}- Hence p(t) — ► p d (t) as i — > +00, and some 



further analysis shows | |Wang and Schirmer, 2 008 1 : 



Theorem 3.5. If p d (t) is a generic state with invariant 
set E = {[pi, P2] = 0} then any solution p(t) con- 
verges to one of the nl critical points p d k \t), and all 

solutions except p d (t) = pd(t), which is stable, are 
unstable. 

Thus we have a similar result as for generic station- 
ary p d . The difference is that for the stationary p d , we 
can present a quantitative result about the dimensions 
of the stable manifolds and hence the measure of solu- 
tions that will converge to these points. For the non- 
stationary target case we can not establish the analo- 
gous result. However, simulations suggest that almost 
all solutions will converge to p d (t), and we can further 



prove a weaker result | Wang and Schirmer, 2008 1 : 



Proposition 3.1. For any of the unstable solutions, 



pf, k = 2,...,n! 
with V(p(0),p d (0)) 
converge to Pd{t). 



— 1, we can find solutions pit), 
> V(p d k) (0),p d {0)), that still 



4 Effectiveness of Method for Non-ideal Systems 

The previous analysis relied on strong assumptions 
about the system, assuming Hq strongly regular and Hi 
fully connected. We shall now relax these requirements 
to see how the invariant set E and the effectiveness of 
the Lyapunov control method change. Without loss of 
generality, we present the analysis for a three-level sys- 
tem, noting that the generalization to n-level systems is 
straightforward. 

First suppose Hq is strongly regular, as for a Morse os- 
cillator, for example, but some of the off-diagonal ele- 
ments of Hi are zero, corresponding to transitions with 
zero transition probability. This is the case for many 
physical systems, where often only transitions between 
adjacent energy levels are permitted, and we rarely 
have non-vanishing transition probabilities for all pos- 
sible transitions. For concreteness, assume n = 3 and 
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where ai > a2 > 0,3- In this case, we 
can prove | Wang and Schirmer, 2008 1 that any point 



[Pl,P2] = 



an 
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Hence, for a stationary and generic target state p d the 
points pi in E must have the form 

(Pu /3 13 N 

Pi = 022 

Wl3 /?33, 

We can prove that near the stationary point p d , the 
invariant set E forms a centre manifold with p d as 
a centre | Wang and Schirmer, 2008 1. Therefore, the 
Hartman-Grobman theorem from the centre manifold 
theory, proved by Carr [ |Carr, 1 981 1, implies that almost 
all solutions near p d (t) converge to the (periodic) solu- 
tions on the centre manifold instead of the centre p d . 
Lyapunov method in this case is ineffective. 
Second, we consider the case of Hi fully connected 
but Ha is not strongly regular. For example, consider 
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with LU12 = UJ23, where u> mn = a m — a n . In this case 
we can also prove that the invariant set E forms a cen- 
tre manifold near p d with p d as a centre, and thus that 
almost all solutions near p d (t) will converge to the pe- 
riodic solutions on the centre manifold other than the 
centre p d , and hence that the Lyapunov method is still 
ineffective. 

In summary, when either of the stringent conditions on 
the Hamiltonians are relaxed even slightly, the invariant 
set E becomes much larger, and in marked contrast to 
the ideal system case, and the Lyapunov method fails 
for almost all cases. 



5 Conclusion and remarks 

We have presented a detailed analysis of the Lyapunov 
control method for bilinear quantum control systems 
based on the application of the LaSalle invariance prin- 
ciple. For the case of non-stationary target states, this 
required considering the dynamics on an augmented 
state space on which the total system is autonomous. 
Characterization and analysis of the invariant set of this 
dynamical system allowed us to establish a quite clear 
picture of the effectiveness of the Lyapunov method 
depending on the properties of the system and the tar- 
get state. In particular, our analysis suggests that the 
method is generally only effective under very strin- 
gent assumptions on the Hamiltonian, and even in this 
case our analysis suggests a rather more complicated 



picture than previously presented in the literature (see 
e.g. lAltafinil 2007at |Altafini, 2007b| ), in that most of 
the critical points, for instance, are unstable but not re- 
pulsive. 

For generic stationary target states, it can be shown 
explicitly that all of the unstable critical points except 
the global maximum in fact have attractive manifolds 
of positive dimension. For target states that are not 
stationary under the action of Ho, there are additional 
complications in that the invariant set can be larger 
than the set of critical points of the Lyapunov func- 
tion, although the set of target states pd{t) for which 
this happens in the ideal system case is of measure 
zero. Thus, while these issues complicate the problem 
for systems with strongly regular free (drift) Hamilto- 
nian Hq and fully connected control Hamiltonian H\, 
Lyapunov control is still generally effective in that for 
most target states pd(t) the invariant set contains only 
the critical points of the Lyapunov function V, and the 
target state pd(t) is the only hyperbolic sink of the dy- 
namical system. 

The situation changes radically when either of the 
twin requirements of strong regularity of Hq and full 
connectedness of Hi are relaxed, even slightly. In this 
case the method becomes not only less effective, but the 
emergence of centre manifolds around the target state 
suggests that the method is likely to become ineffective 
in practice. Since the strict requirements above do not 
appear to be satisfied for most physical systems of in- 
terest, this suggests that the utility of this method for 
practical control field design is rather limited. It would 
be desirable to have stronger analytic results for non- 
stationary target states where well-established tools for 
stability and convergence analysis near fixed points are 
generally no longer applicable. Although some theo- 
retical tools such as the Poincare map and Floquet's 
theorem [Perk o7"2000| exist, to fully answer the ques- 
tion of stability and convergence of Lyapunov control 
for non-stationary (and in general non-periodic) tar- 
get states, even for ideal bilinear Hamiltonian systems, 
would seem to require the development of new tools in 
dynamical systems theory. 
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